Memory hub with internal cache and/or memory access prediction

ABSTRACT

A computer system includes a memory hub for coupling a processor to a plurality of synchronous dynamic random access memory (“SDRAM”) devices. The memory hub includes a processor interface coupled to the processor and a plurality of memory interfaces coupled to respective SDRAM devices. The processor interface is coupled to the memory interfaces by a switch. Each of the memory interfaces includes a memory controller, a cache memory, and a prediction unit. The cache memory stores data recently read from or written to the respective SDRAM device so that it can be subsequently read by processor with relatively little latency. The prediction unit prefetches data from an address from which a read access is likely based on a previously accessed address.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of application Ser. No. 11/592,041, now U.S. Pat. No. 7,644,253, filed Nov. 1, 2006, which is a continuation of application Ser. No. 10/165,787, now U.S. Pat. No. 7,133,972, filed Jun. 7, 2002. These applications are incorporated by reference herein.

TECHNICAL FIELD

This invention relates to computer systems, and, more particularly, to a computer system having a memory hub coupling several memory devices to a processor or other memory access device.

BACKGROUND OF THE INVENTION

Computer systems use memory devices, such as dynamic random access memory (“SDRAM”) devices, to store instructions and data that are accessed by a processor. In a typical computer system, the processor communicates with the system memory through a processor bus and a memory controller. The processor issues a command, such as a read command, and an address designating the location from which data or instructions are to be read. The memory controller uses the command and address to generate appropriate command signals as well as row and column addresses, which are applied to the system memory. In response to the commands and addresses, data are transferred between the system memory and the processor. The memory controller is often part of a system controller, which also includes bus bridge circuitry for coupling the processor bus to an expansion bus, such as a PCI bus.

Although the operating speed of memory devices has continuously increased, this increase in operating speed has not kept pace with increases in the operating speed of processors. Even slower has been the increase in operating speed of memory controllers coupling processors to memory devices. The relatively low speed of memory controllers and memory devices limits the communication bandwidth between the processor and the memory devices.

In addition to the limited bandwidth between processors and memory devices, the performance of computer systems and is also limited by latency problems that increase the time required to read data from system memory devices. More specifically, when a memory device read command is coupled to a system memory device, such as an asynchronous DRAM (“SDRAM”) device, the read data is output from the SDRAM device only after a delay of several clock periods. Therefore, although SDRAM devices can synchronously output burst data at a high data rate, the delay in initially providing the data can significantly slow the operating speed of a computer system using such SDRAM devices.

One approach to alleviating at the memory latency problem is to use multiple memory devices coupled to the processor through a memory hub. Computer systems employing this architecture can have a higher bandwidth because a processor can access one memory device while another memory device is responding to a prior memory access. For example, the processor can output write data to one of the memory devices in the system while another memory device in the system is preparing to provide read data to the processor. However, although computer systems using memory hubs may provide superior performance, they nevertheless often fail to operate at optimum speed. One of the reasons such computer systems fail to operate at optimum speed is that conventional memory hubs are essentially single channel systems since all control, address and data signals must pass through common memory hub circuitry. As a result, when the memory hub circuitry is busy communicating with one memory device, it is not free to communicate with another memory device. Furthermore, although computer systems using memory hubs can provide a greater memory bandwidth, they still suffer from latency problems of the type described above. More specifically, although the processor may communicate with one memory device while another memory device is preparing to transfer data, is sometimes necessary to receive data from one memory device before the data from another memory device can be used. In the event data must be received from one memory device before data received from another memory device can be used, the latency problem continues to slow the operating speed of such computer systems.

There is therefore a need for a computer architecture that provides the advantages of a memory hub architecture and also minimize this latency problems common in such systems, thereby providing a memory devices with high bandwidth and low latency.

SUMMARY OF THE INVENTION

A memory hub that may be used in a computer system includes a memory access device interface coupled to a processor or other memory access device, and a plurality of memory interfaces each of which is coupled to a respective memory device. Each of the memory interfaces includes a memory controller and, according to one aspect of the invention, a memory cache. Each of the memory interfaces is coupled to the memory access device interface by a switch. In operation, data read from or written to a memory device coupled to one of the memory interfaces are stored in the cache memory for the memory interface. In response to a subsequent memory read request, the cache memory is checked to determine whether the data corresponding to the memory read request are stored in the cache memory. In the event of a cache hit, the requested data are provided from the cache memory. Otherwise, the requested data are provided by the memory device. According to another aspect of the invention, each memory interface includes a memory controller and a prediction unit. The prediction unit predicts an address from which data are likely to be read based on an address from a prior memory access. The prediction unit then causes the memory controller in the respective memory interface to read data from the predicted address. The memory hub may be physically included in a system controller, a memory module, or some other component of a computer system or other electronic system using memory devices.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of a computer system according to one embodiment of the invention in which the memory hub is included in a system controller.

FIG. 2 is a block diagram of a computer system according to another embodiment of the invention in which the memory hub is included in a memory module.

FIG. 3 is a block diagram of a memory hub used in the computer systems of FIGS. 1 and 2.

DETAILED DESCRIPTION OF THE INVENTION

A computer system 100 according to one embodiment of the invention is shown in FIG. 1. The computer system 100 includes a processor 104 for performing various computing functions, such as executing specific software to perform specific calculations or tasks. The processor 104 includes a processor bus 108 that normally includes an address bus, a control bus, and a data bus. In addition, the computer system 100 includes one or more input devices 108, such as a keyboard or a mouse, coupled to the processor 104 through a system controller 110 to allow an operator to interface with the computer system 100. Typically, the computer system 100 also includes one or more output devices 114 coupled to the processor 104 through the system controller 110, such output devices typically being a printer or a video terminal. One or more data storage devices 120 are also typically coupled to the processor 104 through the system controller 110 to allow the processor 104 to store data or retrieve data from internal or external storage media (not shown). Examples of typical storage devices 120 include hard and floppy disks, tape cassettes, and compact disk read-only memories (CD-ROMs). The processor 104 is also typically coupled to cache memory 124, which is usually static random access memory (“SRAM”).

The system controller 110 also includes a memory hub 130 for controlling access to several system memory devices 140 a-d, each of which may be a synchronous dynamic random access memory (“SDRAM”). The memory hub 130 allows the processor 104 to write data to and read data from each of the system memory devices 140 a-d. The memory hub 130 is coupled to each of the system memory devices 140 a-d through a bus system 142, which normally includes a control bus, an address bus and a data bus.

Although the memory hub 130 is shown in FIG. 1 coupled to the processor 104, it will be understood that the memory hub 130 may also be coupled to other components in a computer system chipset (not shown). and may also allow other devices (not shown) to write data to and read data from the system memory devices 140 a-d in a direct memory operation, as is well known in the art. Also, the memory hub 130 may be physically included as a part of components of an electronic system other than the system controller 110. For example, a computer system 144 shown in FIG. 2 uses most of the same components that are used in the computer system 100 of FIG. 1. In the interest of brevity, such common components have been provided with the same reference numerals, and an explanation of their operation will not be repeated. The computer system 144 differs from the computer system 100 shown in FIG. 1 in that the memory hub 130 is not included in the system controller 110. Instead, the system controller 110 is coupled to a plurality of memory modules 146, such a double in-line memory modules (“DIMMs”). Each of the memory modules 146 includes the memory hub 130 and a plurality of memory devices 148, which may be SDRAM or some other type of memory device. The memory hub 130 operates in essentially the same manner explained above with reference to FIG. 1 to cache data stored in the memory modules 146.

Although FIGS. 1 and 2 show the memory hub 130 included in the system controller 110 and the memory modules 146, respectively, it will be understood that the memory hub 130 may be a stand-alone unit or it may be included in other components of a computer system or other system using memory devices.

One embodiment of the memory hub 130 is shown in FIG. 3 in which the memory hub 130 is coupled to the processor 104 and three memory devices 140 a-c, which, in the example illustrated in FIG. 3, are SDRAM devices. The memory hub 130 is shown coupled to the processor 104 in a point-to-point arrangement in which there are no other devices coupled to the connection between the processor 104 and the memory hub 130. This type of interconnection provides better signal coupling between the processor 104 and the memory hub 130 for several reasons, including relatively low capacitance, relatively few line discontinuities to reflect signals and relatively short signal paths. However, a multi-drop interconnection may alternatively be used in which other devices (not shown) are coupled to the interconnection between the processor 104 and the memory hub 130.

The memory hub 130 includes a processor interface 150 that is coupled to the processor 104 through a plurality of bus and signal lines, as is well known in the art. The processor interface 150 is, in turn, coupled to a switch 160 through a plurality of bus and signal lines, including a write data bus 154 and a read data bus 156, although a single bi-directional data bus may alternatively be provided to couple data in both directions between the processor interface 150 in the switch 160. The processor interface 150 is also coupled to switch 160 through a request line 164 and a snoop line 168. A snoop signal coupled from the switch 160 to the processor interface 150 through the snoop line 168 is used to maintain cache consistency, as will be described in greater detail below. A request signal coupled from the processor interface 150 to the switch 160 through the request line 164 provides the switch 160 with information corresponding to a request to transfer data through the switch 160. It will be understood, however, that the processor interface 150 maybe coupled to the switch 160 with a greater or lesser number of buses and signal lines or buses and signal lines different from those illustrated in FIG. 3.

The switch 160 is also coupled to three memory interfaces 170 a-c which are, in turn, coupled to the system memory devices 140 a-c, respectively. By providing a separate and independent memory interface 170 a-c for each system memory device 140 a-c, respectively, the memory hub 130 avoids bus or memory bank conflicts that typically occur with single channel memory architectures. The switch 160 is coupled to each memory interface through a plurality of bus and signal lines, including a write data bus 174, read data bus 176 and a request line 178. However, it will be understood that a single bi-directional data bus may alternatively be used instead of a separate write data bus 174 and read data bus 176. Significantly, each memory interface 170 a-c is specially adapted to the system memory devices 140 a-c to which it is coupled. More specifically, each memory interface 170 a-c is specially adapted to provide and receive the specific signals received and generated, respectively, by the system memory device 140 a-c to which it is coupled. Also, the memory interfaces 170 a-c are capable of operating with system memory devices 140 a-c operating at different clock frequencies. As a result, the memory interfaces 170 a-c isolate the processor 104 from changes that may occur at the interface between the memory hub 130 and memory devices 140 a-c coupled to the hub 130, and it provides a more controlled environment to which the memory devices 140 a-c may interface.

The switch 160 coupling the processor interface 150 to the memory interfaces 170 a-c can be any of a variety of conventional or hereinafter developed switches. For example, the switch 160 may be a cross-bar switch that can simultaneously couple at the processor interface 150 and the memory interfaces 170 a-c to each other. The switch 160 can also be a set of multiplexers that do not provide the same level of connectivity as a cross-bar switch but nevertheless can couple the processor interface 150 to each of the memory interfaces 170 a-c. The switch 160 may also includes arbitration logic (not shown) to determine which memory accesses should receive priority over other memory accesses. Bus arbitration performing this function is well known to one skilled in the art.

With further reference to FIG. 3, each of the memory interfaces 170 a-c includes a respective memory controller 180 and a respective cache memory unit 184. The memory controller 180 performs the same functions as a conventional memory controller by providing control, address and data signals to the system memory device 140 a-c to which it is coupled and receiving data signals from the system memory device 140 a-c to which it is coupled. The cache memory unit 184 includes the normal components of a cache memory including a tag memory, a data memory and a comparator, as is well known in the art. The memory devices used in the cache memory unit 184 may be either DRAM devices, static random access memory (“SRAM”) devices, other types of memory devices, or a combination of all three. Furthermore, any or all of these memory devices as well as the other components used in the cache memory unit 184 may be either embedded or stand-alone devices.

The use of the cache memory unit 184 in each memory interface 170 a-c allows the processor 104 to receive data responsive to a read command directed to a respective system memory device 140 a-c without waiting for the memory device 140 a-c to provide such data in the event that the data was recently read from or written to that memory device 140 a-c. The cache memory unit 184 thus reduces the read latency of the system memory devices 140 a-c to maximize the memory bandwidth of the computer system. Similarly, the processor 104 can store write data in the cache memory unit 184 and then perform other functions while the memory controller 180 in the same memory interface 170 a-c transfers the write data from the cache memory unit 184 to the system memory device 140 a-c to which it is coupled.

To further reduce the memory access latency provided by the memory hub 130, each memory interface 170 a-c may be provided with a prefetch unit 190. The prefetch unit 190 is able to predict the likely address of a subsequent memory read request using conventional algorithms. The memory controller 180 in the same memory interface 170 a-c can then perform the memory access in the background while the processor 104 is either accessing a different system memory device 140 or performing other functions. When the processor 104 subsequently provides a command to the memory hub 130 to read data from the predicted address, the read data will already be present in the cache memory unit 180 and can thus be quickly provided to the processor 104.

From the foregoing it will be appreciated that, although specific embodiments of the invention have been described herein for purposes of illustration, various modifications may be made without deviating from the spirit and scope of the invention. Accordingly, the invention is not limited except as by the appended claims. 

1. A memory system, comprising: memory configured to store data in memory locations corresponding to memory addresses; and a memory hub coupled to the memory and configured to receive memory access requests and having a memory interface coupled to the memory, the memory interface comprising: a cache unit configured to store data; a memory controller configured to receive the memory access requests, to access the memory, and in response, generate command and address signals to access memory locations in the memory identified in the memory request; and a prediction unit configured to determine a predicted address for a memory location to be accessed in memory based on previous accesses to the memory and provide the same to the memory controller to generate command and address signals to access the memory location in memory corresponding to the predicted memory address.
 2. The memory system of claim 1 wherein the memory comprises a plurality of random access memory devices.
 3. The memory system of claim 1 wherein the memory hub further comprises a processor interface configured to interface with a processor.
 4. The memory system of claim 3 wherein the memory hub further comprises a switch coupled to the processor interface and the memory interface.
 5. The memory system of claim 1 wherein the memory system comprises a memory module.
 6. The memory system of claim 1 wherein the prediction unit is configured to determine a predicted address for a memory location from which data, is to be read based on previous read operations to the memory.
 7. The memory system of claim 6 wherein the memory controller is configured to generate command and address signals to read data from the memory location corresponding to the predicted memory address and store the read data in the cache unit.
 8. A memory system, comprising: a plurality of memory each configured to store data in memory locations corresponding to memory addresses; a local memory controller coupled to the plurality of memory, the local memory controller having a plurality of memory interfaces each configured to interface with a respective one of the plurality of memory, each memory interface comprising: a cache memory; a prediction unit configured to predict a memory address of a memory location to access based on memory addresses of previously accessed memory locations; and an interface memory controller coupled to the prediction unit and configured to receive the predicted memory address, the interface memory controller further configured to generate command and address signals for accessing the memory location in the respective memory corresponding to the predicted memory address in response to receiving the predicted memory address.
 9. The memory system of claim 8 wherein the interface memory controller is configured to generate command and address signals to read data from the memory location in the respective memory corresponding to the predicted memory.
 10. The memory system of claim 9 wherein the interface memory controller is further configured to store the read data from the memory location corresponding to the predicted memory in the cache memory.
 11. The memory system of claim 8 wherein the plurality of memory comprises a plurality of dynamic random access memory devices.
 12. The memory system of claim 11 wherein the memory system is a memory module.
 13. The memory system of claim 8 wherein the local memory controller further comprises a processor interface configured to interface with a processor.
 14. The memory system of claim 8 wherein the interface memory controller is further configured to store data read from the memory location corresponding to the predicted memory address in the cache memory.
 15. A method for accessing memory locations in memory corresponding to memory addresses, the method comprising: receiving at a memory hub an external memory command to access memory to which the memory hub is coupled; accessing a memory location in memory identified by the external memory request; within the memory hub, predicting a memory address for a memory location to be accessed based on prior memory accesses to the memory; and accessing the memory location corresponding to the predicted memory address without receiving an external memory commands identifying the accessed memory location.
 16. The method of claim 15 wherein accessing the memory location corresponding to the predicted memory address comprises reading data from the memory location corresponding to the predicted memory address.
 17. The method of claim 16, further comprising storing the data read from the memory location corresponding to the predicted memory address in a cache memory.
 18. The method of claim 15 wherein predicting a memory address for a memory, location to be accessed based on prior memory accesses to the memory comprises predicting a memory address for a memory location to be accessed based on prior memory write operations to the memory.
 19. The method of claim 15 wherein accessing a memory location in memory identified by the external memory request comprises accessing a memory location in a dynamic random access memory device. 